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ABSTRACT 


In this paper we present a simple testbed for experimenting with C4ISR architectures 
(based on a “SCUD hunt” scenario), the FINC methodology for analysing C4ISR 
architectures, and some experimental results. The testbed allows us to explore different 
organisational architectures under a range of conditions. The FINC (Force, Intelligence, 
Networking and C2) methodology allows the calculation of three metrics for every 
C4ISR architecture. Applying the FINC methodology to our testbed provides a partial 
validation of the methodology, as well as allowing us to derive four basic principles of 
C4ISR architectures. 
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Executive Summary 


In responding to the Revolution in Military Affairs and rapid change in the modern 
strategic environment, it is important to utilise the best possible C4ISR architectures for 
the Australian Defence Force. Consequently, it is extremely important to evaluate the 
effectiveness of different C4ISR architectures. This can be done using the regular series 
of military exercises. However, these are not capable of examining the impact of 
technologies not yet in service. Wargaming is capable of examining such technologies, 
but both wargaming and real exercises have a substantial cost, and therefore there is 
considerable benefit in a low-cost methodology for evaluating C4ISR architectures, and 
selecting for further experimentation those which the methodology identifies as the 
best candidates. The FINC (Force, Intelligence, Networking and C2) methodology 
satisfies this goal. 


The FINC methodology allows the calculation of three metrics for every C4ISR 
architecture: the information flow coefficient measuring tempo superiority, the 
coordination coefficient measuring coordination superiority, and the intelligence 
coefficient measuring information superiority. 


Like all methodologies, the FINC methodology requires validation, and this report 
describes the first step in validating it. For this first step, we utilise a testbed (based on 
a “SCUD hunt” scenario) which is simple, yet allows us to explore the impact of 
different organisational architectures under a range of different conditions. 


Applying the FINC methodology to our experimental testbed allows us to derive four 
basic principles of C4ISR architectures, and an indication of which military 
organisational structures are appropriate for different tempo/information quality 
regimes. Our experiments indicate that at slow to moderate tempo with poor sensors, 
intelligence superiority (indicated by a high intelligence coefficient) is the most critical. 


At slow tempo with fair to good sensors, coordination superiority (indicated by a low 
coordination coefficient) is also important, and a highly centralised architecture (such 
as the use of highly centralised Air Tasking Orders by the US Air Force) performs well 
in this regime. 


At moderate tempo with fair to good sensors, tempo superiority (indicated by a low 
information coefficient) is also important, and network-centric warfare seems to 
perform well in this regime. 


At high tempo, coordination superiority is less important than intelligence superiority 
and tempo superiority, and taking time to achieve perfect coordination may be 
detrimental in this regime. Table (i) summarises these results. 


Table (i): Summary of Results 


tl Poor sensors Fair to Good sensors 


Slow tempo : Region B: Balance information superiority and 
Region A: coordination superiority (high intelligence 
Inf ormation coefficient and low coordination coefficient) 

Moderate Super Orety, Region C: Balance all three kinds of 

tempo 18 most important | s.neriority (high intelligence coefficient, low 
eu err aa information flow coefficient, and low 


coordination coefficient) 
Region D: Balance information superiority and tempo superiority 
(high intelligence coefficient and low information flow coefficient) 


These results were obtained by analysing performance of different C4ISR architectures 
for our experimental testbed. Figure (i) shows two of the eight architectures examined. 
All eight architectures are defined in detail in the body of the report. 
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1. Introduction 


In this paper we discuss the application of Social Network Analysis concepts [1, 2] to 
C4ISR (Command, Control, Communications, Computers and _ Intelligence, 
Surveillance & Reconnaissance) architectures. In particular, we describe the FINC 
methodology [3], which calculates a number of metrics for evaluating C4ISR 
architectures. 


We also present a simple experimental testbed for evaluating some C4ISR 
architectures, and some experimental results which validate the FINC methodology. 
We believe that, in order to gain understanding of organisational design, it is 
important to use simple and easily understood testbeds that permit rapid 
experimentation, in much the same way that early experiments with rapidly- 
breeding fruit flies [4] led to modern successes in genetic engineering. We share this 
belief with the Carnegie Mellon group, which has published extensive studies using 
a simple testbed focused on bureaucratic organisations [5, 6]. The use of agent-based 
distillations for studying military operations [17], and Conway's famous “Game of 
Life” are based on similar philosophies of experimentation. 


For our purposes, we require a testbed more closely aligned with military activities, 
and which models an organisation not only as an information-processing structure, 
but which also includes the interactions between the organisation and _ its 
environment. The organisation receives information (intelligence) from [5 
environment, makes decisions, and produces some effect on the environment. In this 
way, it resembles a model of a biological organism, and like an organism, the 
performance of a military organisation depends on the appropriateness of its 
response to its environment. The testbed we use is based on the SCUDHunt [7] 
game, which was originally designed for experiments on the coordination of virtual 
(distributed) teams using different communication tools. This testbed is precisely 
suited to our purpose since it is simple, yet has an interesting range of behaviour, 
allowing us to explore the impact of different organisational architectures under a 
range of different conditions. 


This paper is divided into three main parts: the first discusses our experimental 
testbed and the results of experimentation, the second describes the FINC 
methodology, and the third applies the FINC methodology to our experimental 
results, allowing us to derive four basic principles of C4ISR architectures, which are 
outlined in table 7 at the end of the paper. 


1.1 C4ISR Architectures 


The term C4ISR architecture [8] is used by the US and other militaries to refer to the 
organisational structure used by military forces in carrying out a mission. The key 
aspect of C4ISR is command (authority and responsibility) and control (exercising 
authority over subordinates). These two indivisible aspects of leadership are 
referred to as C2. Since communications and computer technology are important in 
carrying out these leadership functions in a large organisation, the acronyms C3 and 
C4 are used to include these facilities. 
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Since leadership cannot be carried out without information of some kind, the 
acronyms C3I and C4I are used to include intelligence, which means the collection of 
relevant information. The acronym C4ISR includes two specific sources of 
information: surveillance (systematic observations of something) and 
reconnaissance (observations on a specific occasion). 


Traditionally military structures have been very hierarchical, but modern 
innovations in communications and computer technology have made a wide range 
of other structures possible. At the same time, an emerging emphasis on operations 
other than war may require more flexible non-traditional organisational structures. 
In this environment, there is a need for formal techniques for the evaluation of a 
wide range of organisational structure options. We believe that Social Network 
Analysis techniques are the obvious choice for such evaluation. 


1.2 Social Network Analysis 


Social Network Analysis is an approach to analysing organisations focusing on the 
relationships between people and/or groups as the most important aspect. Going 
back to the 1950's, it is characterised by adopting mathematical techniques especially 
from graph theory [9, 10]. It has applications in organisational psychology, sociology 
and anthropology. A good summary is found in [1]. 


The first goal of Social Network Analysis is to visualise communication and other 
relationships between people and/or groups by means of diagrams. The second goal 
is to study the factors which influence relationships and to study the correlations 
between relationships. The third goal is to draw out implications of the relational 
data, including bottlenecks where multiple information flows funnel through one 
person or section (slowing down work processes) and situations where information 
flows does not match formal group structure. The fourth and most important goal of 
Social Network Analysis is to make recommendations to improve communication 
and workflow in an organisation, and (in military terms) to speed up the orient- 
observe-decide-act (OODA) loop or decision cycle. 


Social Network Analysis provides an avenue for analysing and comparing formal 
and informal information flows in an organisation, as well as comparing information 
flows with officially defined work processes. In previous work, we have applied 
Social Network Analysis to military organisations in more or less standard ways [2]. 
In this paper, we describe an extension to traditional Social Network Analysis for the 
specific area of C4ISR architectures which we call the FINC (Force, Intelligence, 
Networking and C2) methodology. We have constructed a Java-based tool called 
CAVALIER [18], to carry out this and other forms of Social Network Analysis. 
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Figure 1: Experimental Testbed: Centralised Architecture 


2. The Experimental Testbed 


The testbed we use is based on the SCUDHunt [7] game, which was originally 
designed for experiments on the coordination of virtual teams. The area of operations 
is a 4x4 grid which contains four randomly-located missile launch sites (see figure 1). 
Two kinds of sensors are used to locate the launch sites: four surveillance aircraft fly 
along the columns of the grid, producing intelligence on the columns, while a 
satellite provides intelligence on the entire grid. Both kinds of sensors have a quality 
factor q (ranging from 0.1 to 0.9), and on each grid square sensors fail with 
probability 1-g, reporting a missile launch site even if none exists in that square. 
Consequently, the intelligence data may include “ghost” missile launch sites (“false 
alarms”), as shown in figure 1 (the figure is produced by our Java-based CAVALIER 
tool). There are no failures to detect targets, i.e. every target is detected, so that there 
will always be at least four targets reported. Reported positions for the real targets 
are also completely accurate (i.e. there are no ambiguities in location). Combining 
intelligence sources (sensor fusion) gives a more accurate picture than single sensors 
would, since the chance that two sensors will fail simultaneously on the same grid 
square is reduced. The testbed is programmed to ensure that two launch sites never 
occupy the same grid square, so that the sensor fusion process is trivial. 


There are four fighter squadrons that must destroy the missile launch sites. Each 
fighter squadron can be assigned to only one (real or ghost) launch site, so that the 
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presence of ghost launch sites reduces the chance that the real sites will be destroyed. 
To complicate matters further, the air strikes occur after a delay due to planning. 
Planning requires a number of time steps, and at each time step, there is a 
probability p (ranging from 0.01 to 0.5) that any particular launch site will move to a 
safe location, in which case the fighter strike will be unsuccessful. The probability p 
thus provides an indirect measure of battlefield tempo: at a low value of p = 0.01 
(slow tempo), there is a better than even chance that launch sites will remain at the 
location where they were detected, even after 68 time steps. Hence rapid response is 
not critical in this case. At moderate values of p = 0.05 or p = 0.1 (moderate tempo), 
there is still a better than even chance that launch sites will remain at the location 
where they were detected after 6 time steps. However, at the high value of p = 0.5 
(fast tempo), after only one time step there is an even chance that launch sites will 
have moved to a safe location, after two time steps this has become a 75% chance, 
after three time steps, 87.5%, etc., making rapid response extremely critical in this 
case. 


For each run of the experiment, we choose four randomly-located launch sites, and 
simulate a single strike mission. The measure of performance is the number of 
missile launch sites destroyed (which will range from 0 to 4). To produce statistically 
valid results, for each C4ISR architecture and combination of p and 4, we average the 
performance of 10,000 experimental runs. 


This experimental testbed satisfies our “fruit fly” condition of being simple and 
easily understood, and enables us to explore the impact of different C4ISR 
architectures under all possible combinations of p and q. For this experiment, we 
study the performance of eight C4ISR architectures: centralised, split, distributed, 
and negotiation, with and without information sharing. 


2.1 The Centralised Architecture Without Information Sharing 


In the centralised architecture (see figure 1), intelligence data (from the surveillance 
aircraft and the satellite) is collected by an intelligence headquarters (Int HQ) and 
combined to produce a reference intelligence picture, and a list of targets (which 
includes the four real missile launch sites plus zero or more ghost sites). The list of 
targets is passed to the top-level headquarters (HQ) which chooses four of the targets 
and assigns them to the four fighter squadrons (in US Air Force doctrine, this is 
called an Air Tasking Order, or ATO). Air strikes occur 5 time steps after intelligence 
collection begins. 


The centralised architecture is the preferred model of the US Air Force, which 
generally operates with air superiority in support of joint operations (see [11] for a 
description of the air campaign during the Gulf War). The US Air Force possesses 
very good communications and intelligence capability (particularly AWACS aircraft) 
and the inherent speed of aircraft makes it relatively easy to position assets in the 
battle space. Air superiority allows the US Air Force to set the tempo of the battle. 
All these factors make the centralised architecture a good choice for the US Air Force, 
as we will see later. 
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Figure 2: Split Architecture 


2.2 The Split Architecture Without Information Sharing 


The split architecture (see figure 2), is similar to the centralised architecture, but the 
top-level headquarters only partitions the battlespace between two wings (each 
consisting of two squadrons). This is done by drawing a vertical line through the 
grid so that there are roughly the same number of targets on either side (usually, but 
not always, this vertical line will pass through the centre of the grid). The left and 
right sides of the partition are assigned to the two wings, and each wing 
headquarters then assigns its two squadrons to two of the targets in its area of 
responsibility. Because of the additional level of command, with this architecture air 
strikes occur 6 time steps after intelligence collection begins. 


The split architecture is essentially the traditional land force structure. Land 
operations usually involve problems which are too complex for centralised 
optimisation, and so benefit from being hierarchically subdivided [16]. The split 
architecture thus provides some of the benefits of centralised-planning with tactical 
adjustments to new information by subordinate units. However, this architecture is 
not guaranteed to produce an optimal solution if tempo is high, since the delays 
inherent in the hierarchy may negate the benefits of centralised planning. For 
example, in the Gulf War ground campaign, Norman Schwarzkopf acted as both 
CINC and ground component commander, and there were two levels of command 
(3rd Army and VII and XVIII Corps) between him and the US Army divisions on the 
ground, although a single level may have been more appropriate. General (Ret) Fred 
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Franks (who commanded VII Corps) in his assisted autobiography [12] records a 
number of ways in which the multiple levels of hierarchy caused delays and 
misunderstandings which partially compromised the success of this high-tempo 
campaign. In the words of Clausewitz, cited in [16]: 


“There is no denying that the supreme command of an army... is markedly simpler if orders 
only need to be given to three or four other men; yet a general has to pay dearly for that 
convenience... an order progressively loses speed, vigor and precision the longer the chain of 
command it has to travel, which is the case where there are corps commanders placed between 
the divisional commanders and the general.” 


It should be pointed out, however, that our experiment does not entirely do justice to 
this model because our task is too simple to benefit from being hierarchically 
decomposed: it can be effectively solved centrally. Our experiment also does not 
allow for tactical adjustments to a central plan, and in future work we intend to 
address this. 


2.3 The Distributed Architecture Without Information Sharing 


In the distributed architecture (see figure 3), there are four independent commands. 
Each command “owns” a column of the grid, with one surveillance aircraft and one 
fighter squadron dedicated to that column. Each independent command also 
receives satellite intelligence. Due to the short sensor-to-shooter pathway and the 
reduced need for coordination, with this architecture air strikes occur only 3 time 
steps after intelligence collection begins. However, it is possible for one column to 
have many targets, only one of which receives an air strike, while another column 
has its fighter squadron unused. 
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Figure 3: Distributed Architecture without Information Sharing 


The distributed architecture is the traditional model of special operations, where 
communications are poor or non-existent, and lethal events which can terminate the 
mission can occur on a minute-by-minute basis. In such an environment, it is 
appropriate for units on the ground to make decisions without reference to higher 
command. 


2.4 The Negotiation Architecture Without Information Sharing 


The negotiation architecture (see figure 4), is similar to the distributed architecture, 
but each independent command can pass excess targets in its column to the 
commands on its immediate left and right. This produces a result intermediate 
between the centralised and distributed architectures, and air strikes with this 
architecture occur 4 time steps after intelligence collection begins. 
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Figure 4: Negot 


The negotiation architecture (also known as peer-to-peer) is the traditional model of 
emergency services (fire and ambulance) where each station is independently 
responsible for a fixed area. This is appropriate, since for emergency services speed 
of response is essential above all. Should a station be overloaded with multiple 
emergencies, it can negotiate with adjacent stations to handle the excess calls. Only 
for major (city-wide or state-wide) emergencies is a centralised command structure 
put into place. 


2.5 Architectures with Information Sharing 


Each of the above architectures has an information sharing variant, in which the 
surveillance aircraft are upgraded to provide intelligence not only on the column 
along which they fly, but also on the immediately adjacent columns. For the 
centralised and split architectures, this additional intelligence is handled by the 
intelligence headquarters. For the distributed (see figure 5) and negotiation (see 
figure 6) architectures, this requires additional communication pathways from the 
surveillance aircraft to adjacent commands. In either case, the additional information 
is obtained at a cost of 1 additional time step. 
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Figure 5: Distributed Architecture with Information Sharing 


The negotiation architecture with information sharing represents the emerging 
paradigm of Network Centric Warfare [13], where information is shared through a 
network of sensors. Network Centric Warfare (NCW) realises its full potential where 
units can negotiate tasks with each other (self-synchronisation) in response to rapidly 
changing situations without first contacting higher command. In the words of David 
Alberts et al [13]: 


“NCW offers the opportunity not only to be able to develop and execute highly synchronized 
operations, but also to explore C2 approaches based upon horizontal coordination, or self- 
synchronization, of actor entities. In fact, the Marines have adopted Command and 
Coordination as their preferred term for command and control in future operations.” 


Table 1 summarises the eight architectures and their associated time delays. 
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Figure 6: Negotiation Architecture with Information Sharing 


Table 1: Eight C4ISR Architectures and Associated Time Delays 


| No Information Sharing | Information Sharing __| 
[Centralised ὁ ὁὅἜἋΦὅΘΦ5Φὖὅ6Θδ 5΄ὖ΄ὁὲ5ὁὃ6ιἜι:΄ ΄-Όϑ»ᾺΆᾳἨῤἠἨοῤ ο ὀᾷῤ  ᾽ Τ΄πἦπ ἠ 6Ὃ.6ὉὮὉὮἪὮἪὃ 1 
[Distributed ὃ ὃΝΎΝΕΕ͵Ι 85ϑὃὅὃὋὍὋὅὈὍοΈὍἝῆ Ζ  ῤ ΦἩΦῬΦῬϑ 4 
[Negotiation ὁ ὁὅὍΌᾳΎθοθπ ΡΘθΘθΡΘΓΡ ΡῬᾶῆῳΑ,,ι:.ο.͵.͵ ἮΤΨΘὁ'᾽'αἙἙἉἜὁἝΘἝΘἝΘὁ 5ϑ. 

aE eee Στὸ τ 


10 
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3. Experimental Results 


Table 8 in the appendix shows the number of missile launch sites destroyed for each 
of the eight architectures, under various combinations of tempo p and sensor quality 
4. Each number in the table is the average of 10,000 experimental runs. The best 
performance for each combination of p and q is indicated by an asterisk. 


Table 2 shows the average number of missile launch sites destroyed for each of the 
eight architectures (averaged over all combinations of p and ἡ examined). The 
overall best-performing architecture is the negotiation architecture with information 
sharing. The centralised architecture with information sharing and the negotiation 
architecture without information sharing also perform better than the overall average 
of 1.503 targets destroyed. 


Table 2: Average Performance for Eight Architectures 
Negot. | Split 


Overall | Centralised | Distributed | Negotiation Centr. | Distr. 
Average Share Share | Share Share 


1.339 


Table 3 shows the best-performing architecture for each combination of tempo p and 
sensor quality g. It can be seen that the performance of each architecture depends 
very much on tempo and sensor quality. The overall best-performing architecture 
(negotiation with information sharing) is highlighted, and it can be seen that this 
architecture is only best for certain combinations of tempo and sensor quality. It can 
also be seen that the transition from distributed architecture being best to centralised 
architecture being best (whether vertical or horizontal) always has an intermediate 
stage where the negotiation architecture is best. However, before we discuss our 
experimental results further, we will introduce the FINC methodology. 


Table 3: Best-Performing Architectures for Tempo and Sensor Quality Combinations 


11 
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4, The FINC (Force, Intelligence, Networking and 
C2) Methodology 


In this section we describe the FINC methodology [3], using a simple military 
structure (figure 7) as an illustrative example. In this example, two brigade-level 
units (BDE 1 and BDE 2) are controlled by a divisional-level headquarters (DIV HQ), 
which in turn is controlled by a joint headquarters (NT HQ) which also controls 
strategic intelligence and air assets. We provide this example structure purely in 
order to describe the FINC methodology, and are not suggesting that it is 
appropriate for any specific purpose. In the next section of this paper we provide an 
application of the FINC methodology to our “SCUD hunt” experiment. 


he 
ee 


Figure 7: A Simple Military Organisational Structure 


The FINC methodology analyses an organisational structure relatively simply in 
terms of force, intelligence, networking, and C2 assets. Force assets are those which 
carry out any kind of military task, and are indicated by square boxes in figure 7. 
Intelligence assets collect any kind of information, and are indicated by rounded 
boxes in figure 7. Networking provides communication between assets, indicated by 
lines or arrows in figure 7 (depending on whether information flow is unidirectional 
or bidirectional). C2 (command and control) assets make decisions, and are 
indicated by circles in figure 7. The force and intelligence assets are often themselves 
organisations that can be subdivided in a similar way, if necessary. Having divided 
an organisation in this way, the FINC methodology provides a number of metrics, 
for evaluating the efficiency of the organisational structure. 


The FINC methodology is also applicable to business organisations. For example, 
the force assets which carry out tasks could include the sales force and business 
units; intelligence assets could include research and development, market research, 
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and recorded sales figures; and C2 assets could include management and decision- 
makers. 


Each force and intelligence asset has an associated area of operations, which for 
simplicity is assumed to be approximately circular. In figure 7 these assets are: 


Scout unit 1 (Intelligence), radius = 100 (in arbitrary units) 

Scout unit 2 (Intelligence), radius = 100 

Brigade BDE 1 (Force), radius = 100 

Brigade BDE 2 (Force), radius = 100 

Strategic air (STRAT AIR) assets (Force), radius = 400 

Strategic intelligence (STRAT INT) assets (Intelligence), radius = 400 


In cases where the areas of operation for intelligence and force assets overlap, there is 
benefit in providing a flow of information from the intelligence asset to the force 
asset. In figure 7, candidate information flows are: 


Scout unit 1 to Brigade BDE 1 
Scout unit 2 to Brigade BDE 2 
Strategic intelligence (STRAT INT) to Brigade BDE 1 
Strategic intelligence (STRAT INT) to Brigade BDE 2 


Scout unit 1 to Strategic air (STRAT AIR) 
Scout unit 2 to Strategic air (STRAT AIR) 
Strategic intelligence (STRAT INT) to Strategic air (STRAT AIR) 


Note that intelligence from Scout units is only useful to their associated Brigade 
units, since in this example, the areas of operation of the two brigades do not 
overlap. However, the strategic intelligence and air assets (with radius = 400) 
overlap with both brigades. 


Intelligence assets differ in the kind of information they provide. Although such 
differences can be quite complex, for simplicity we model this by associating a mode 
or band with each intelligence asset. If a single asset produces different kinds of 
information, we simply model it as multiple co-located assets. We assume that two 
intelligence assets in different bands are complementary, while intelligence assets in 
the same band provide duplicate information. Intelligence assets also differ in the 
quality of information they provide. We model this using a numerical quality score 
for each intelligence asset. Given two intelligence assets in the same band, we prefer 
the highest quality information, and can discard the lower quality information. For 
figure 7, intelligence assets are assumed to be in the same band, and quality (in 
arbitrary units) is taken to be: 


Scout unit 1 (Intelligence), quality = 0. 
Scout unit 2 (Intelligence), quality = 0. 
Strategic intelligence (STRAT INT) assets (Intelligence) quality = 0.2 


σι ὦ 


In other words, the strategic intelligence assets in this example provide information 
which overlaps with the information provided by scout units, and which is lower- 
quality but available over a wider area (we emphasise that this example is not 
realistic, and is provided merely to illustrate the methodology). The issue of how 
actual sensor characteristics are translated to numerical quality scores is outside the 
scope of the present paper, and we intend to address this in future work. 
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Each communication link in the network has varying reliability and bandwidth 
characteristics which for simplicity we model as an average delay factor for the 
transfer of information across the link. The key idea here is not the message 
transmission time, but the time to get across an understanding of reports or 
instructions. This may require multiple exchanges and clearly takes longer with low- 
bandwidth communication while face-to-face communication reaches understanding 
more rapidly. Delays (in arbitrary units) are indicated on the links in figure 7. For 
the experiment we describe in this paper, the delay factors are estimated (based on 
the description of the experimental testbed in the previous section), but for real- 
world studies we calculate the delay using a formula which is simple, but still of 
value in predicting performance: 


delay factor = actual delay * misunderstanding factor | amount of information 


Here the actual delay is the time required to actually send the block of information, 
1.6. the transmission time plus the average time between transmissions. This will 
depend on communications bandwidth, availability of the communications 
technology involved, set-up time, and standard operating procedures. The amount 
of information per transmission is measured in bytes (assuming the best possible 
compression technology is used). The misunderstanding factor is usually taken to be 
1.0, but for organisations which involve multiple cultures, the misunderstanding 
factor will be greater than 1.0 for cross-cultural links. Such cross-cultural links 
include communication between different services (such as between the US Army, 
Air Force, and Marines in the Gulf War [11, 12]), or communication between units 
from different countries. Further work is still needed to assess the suitability of this 
calculation of the delay factor. 


Each C2 node in the architecture processes intelligence information and passes it on 
(as well as many other C2 functions). This introduces an additional delay factor 
which is added to the delay factor for communication links. In figure 7, all delays for 
C2 nodes are assumed to be 1.0 (in the same arbitrary units as for links). 


The FINC methodology uses the information in this model to conduct three kinds of 
analysis: delay analysis, centrality analysis, and intelligence analysis. 


4.1 Delay Analysis 1: the information flow coefficient 


In delay analysis, we consider the combined delay (ie. the combination of 
communication delays and C2 delays) for each candidate information flow. Where 
multiple communication paths exist, we take the one with the shortest delay. For 
figure 7, the delays for the candidate information flows are: 


Scout unit 1 to Brigade BDE 1, delay = 2.0 + 1.0 + 1.0 4. 
Scout unit 2 to Brigade BDE 2, delay = 2.0 + 1.0 + 1.0 4. 
Strategic intelligence (STRAT INT) to Brigade BDE 1, delay 


Strategic intelligence (STRAT INT) to Brigade BDE 2, delay 


ih it 

uou 
rioo 
so 4 
oo 


Scout unit 1 to Strategic air (STRAT AIR), delay .0 
Scout unit 2 to Strategic air (STRAT AIR), delay .0 
Strategic intelligence (STRAT INT) to Strategic air (STRAT AIR), delay = 3.0 


mu 
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The first metric we use for assessing C4ISR architectures is simply the average of 
these delay values, which we call the information flow coefficient. It provides a 
measure of how effectively the military organisation can mobilise information to 
carry out a task. For the example in figure 7, this coefficient is 5.0. For this metric, 
low values are desirable. 


The information flow coefficient provides one simple way of assessing changes to to 
the military structure. For example, eliminating the direct links between scout units 
and strategic air assets in figure 7 reduces the effectiveness of information flow, and 
increases the information flow coefficient to 5.86. Since it measures the delay 
between obtaining information and acting on it, the information flow coefficient 
provides an indication of tempo superiority, i.e. the ability to react more rapidly 
than an adversary. 


4.2 Delay Analysis 2: the coordination coefficient 


The second metric we use for assessing C4ISR architectures is the coordination 
coefficient. It provides a measure of how effectively the military organisation can 
coordinate activities. This metric is calculated by averaging the delays along paths 
connecting force assets. This is very similar to the information flow coefficient, but 
the information flow coefficient considers paths from relevant intelligence assets to 
force assets, while the coordination coefficient considers paths between force assets. 
For the example in figure 7, these paths are: 


Brigade BDE 1 to Brigade BDE 2 and vice versa, delay = 7.0 
Brigade BDE 1 to Strategic air (STRAT AIR) and vice versa, delay 


7.0 
Brigade BDE 2 to Strategic air (STRAT AIR) and vice versa, delay 7.0 


Consequently, the coordination coefficient is 7.0. For this metric, low values are also 
desirable. It provides an indication of coordination superiority, i.e. the ability to 
orchestrate (in the words of General Sir John Monash) multiple actions more 
effectively than an adversary. 


4.3 Centrality Analysis 


In centrality analysis, we try to identify the most “central” node in the architecture, 
which provides some indication of the “centre of gravity” [14] of the structure. 
Centrality is a traditional idea in Social Network Analysis, and there are several 
possible definitions of the concept [1], but a suitable definition for the degree of 
centrality of node i in a network where there is a concept of varying “distance” or 
“strength” of links is: 


Y AVERAGE (j [Ξ ὃ {1 / delay (i, j)} + % AVERAGE (j != ὃ {1 / delay (ἢ) 


i.e. the centrality score for a particular node is the sum of inverse distances to all the 
other nodes — the most central node is the one that is “closest” to everything else. 
Node that in general the delay from i to j may be different from the reverse delay. 
For the example in figure 7, the delay from STRAT INT to STRAT AIR is 2.0, but the 
reverse delay is infinite, since the link from STRAT INT to JNT HQ is unidirectional. 
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For the network in figure 7, the most central node is the divisional headquarters (DIV 
HQ), while the second most central node is the joint headquarters (NT HQ). This 
provides an indication that the architecture in figure 7 is indeed a land-focused 
rather than a joint-focused structure. 


Note that we do not use centrality analysis in analysing our “SCUD hunt” 
experiment. 


4.4 Intelligence Analysis: the intelligence coefficient 


Our third form of analysis measures the degree to which intelligence is used. For 
each candidate information flow from an intelligence asset to a force asset (which 
uses the intelligence), we estimate the effective intelligence quality to be the 
intelligence quality discussed above divided by the delay factor for the path, to allow 
for the decrease in value of information as it ages. This is a somewhat crude 
calculation, since some information retains its value even after considerable time has 
passed, while other information becomes useless almost immediately. However, this 
calculation provides a simple approximation to the way that information loses value 
over time. For the example in figure 7 we have: 


Scout unit 1 to BDE 1, delay 
Scout unit 2 to BDE 2, delay 
STRAT INT to BDE 1, delay 
STRAT INT to BDE 2, delay 


4.0, quality = 0.5, effective quality 0.125 
4.0, quality = 0.5, effective quality 0.125 
7.0, quality = 0.2, effective quality = 0.029 

7.0, quality = 0.2, effective quality = 0.029 


soft 


Scout unit 1 to STRAT AIR, delay = 5.0, quality = 0.5, effective quality 


tt 


Scout unit 2 to STRAT AIR, delay 


5.0, quality = 0.5, effective quality 


STRAT INT to STRAT AIR, delay = 3.0, quality = 0.2, effective quality 


These calculations are repeated for each intelligence band or mode. 


For each force asset and intelligence band, we calculate an intelligence volume 
which is the product of effective intelligence quality and relative area (within the 
area of operations of the force asset) covered by the intelligence information. In cases 
where the areas of operations of intelligence and force assets only partially overlap, 
we assume that there is sufficient flexibility of position to make this overlap total 
when needed. 


For example, for the strategic air (STRAT AIR) asset in figure 7, strategic intelligence 
covers the entire area of operations (radius = 400) with effective intelligence quality = 
0.067, while the two scout units cover smaller areas (radius = 100) with slightly 
higher effective intelligence quality = 0.1.of the same kind of information. Figure 8 
illustrates this: 


DSTO-GD-0313 


Figure 8: Intelligence Volume for Strategic Air Asset 


In this diagram, the intelligence assets relevant to STRAT AIR are indicated by 
transparent green cylinders. The area of each cylinder indicates the physical area 
covered by the intelligence asset. The height of each cylinder indicates the 
corresponding effective intelligence quality, so that the two cylinders representing 
-scout units stand out above the slightly lower effective intelligence quality of the 
strategic intelligence (STRAT INT) asset. The intelligence volume for the strategic 
air asset is simply the total volume of the combined shape (divided by pi for 
simplicity): 

intelligence volume for STRAT AIR 

0.067 * 400 * 400 + (0.1 - 0.067) * 100 * 100 + (0.1 - 0.067) * 100 * 100 


= 10720 + 330 + 330 
= 11380 


The intelligence volume for each brigade ignores strategic intelligence assets, since 
for this example we assume that the scout units provide exactly the same kind of 
intelligence and they have a higher effective intelligence quality of 0.125: 


intelligence volume for BDE 1 or BDE 2 
= 0.125 * 100 * 100 
= 1250 


The intelligence coefficient of the architecture is simply the total of the intelligence 
volumes for each force asset and intelligence band. For figure 7 this is 11380 + 1250 + 
1250 = 13800, approximately. For this metric, large values are desirable. 


The intelligence coefficient can be improved either by improving the quality of 
individual intelligence assets, decreasing the delay on communication paths, or by 
adding intelligence assets (on new bands) which complement existing assets. We 
believe this metric provides a reasonable way of assessing the impact of such 
changes. Essentially this metric provides an indication of information superiority, 
i.e. the ability to obtain and utilise information more effectively than an adversary. 
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5. Modelling the Testbed with the FINC 
Methodology 


For the purposes of the FINC methodology, we model our eight experimental 
architectures with a delay factor of 1 for each headquarters and link, unless 
otherwise specified. This is sufficient to describe the centralised, distributed, and 
split architectures without information sharing. The link delays (but not the 
headquarters delays) are shown in figures 1 through 6. For the negotiation 
architectures, we need to model the extra delay due to the negotiation process. We 
do this by adding an extra 0.5 to the delays on each headquarters, which adds 1 to 
the total path delays between adjacent squadrons. 


For the information sharing architectures, we need to model the extra delay due to 
processing the additional intelligence. For the centralised and split architectures we 
can do this easily by increasing the delay on the intelligence headquarters from 1 to 2 
to allow for the increased workload. For the distributed and negotiation 
architectures (which have no intelligence headquarters) we model the delays 
associated with information sharing by placing a delay factor of 2 on the new 
intelligence links to adjacent columns plus an extra delay of 0.5 on each 
headquarters. 


The process of modelling the eight experimental architectures by choosing delay 
values for each headquarters and link (which we have just described) has been 
largely based on estimation. For a real-life scenario, a similar estimation process 
would be necessary. However, once the estimated delay values have been chosen, 
we can calculate the information flow coefficient, coordination coefficient and 
intelligence coefficient using the procedures outlined in the previous section. For 
example, for the centralised architecture without information sharing, we have the 
following candidate information flows and total path delays: 


Surveillance plane 1 to Squadron 1, delay 
2 atutance plane 2 to Squadron 2, delay = 1.0 + 1.0 + 1.0 + 1.0 + 1.0 = 
2 ines plane 3 to Squadron 3, delay = 1.0 + 1.0 + 1.0 + 1.0 + 1.0 = 
are ΕΥΤΕ plane 4 to Squadron 4, delay = 1.0 + 1.0 + 1.0 + 1.0 + 1.0 = 
5.0 


1.0 + 1.0 + 1.0 + 1.0 + 1.0 = 


Satellite to Squadron 1, delay = 1.0 + 1.0 τ 1.0 - 1.0 τὄ 1.0 = 5.0 
Satellite to Squadron 2, delay = 1.0 τ 1.0 τ 1.0 -ὄ 1.0 τ 1.0 = 5.0 
Satellite to Squadron 3, delay = 1.0 + 1.0 τ 1.0 - 1.0 τ 1.0 = 5.0 
Satellite to Squadron 4, delay = 1.0 + 1.0+1.0+1.0+1.0 = 5.0 


The information flow coefficient is the average of these (identical) delay values, 
which is 5.0. Table 4 shows the information flow coefficient (info), the coordination 
coefficient (coord), and the intelligence coefficient (intel) calculated in a similar way 
for each of the eight experimental C4ISR architectures (the actual calculations were 
performed by our CAVALIER tool). Figure 9 shows the same information 
graphically. Calculation of the intelligence coefficient requires modelling sensor 
quality. We do this using the sensor quality discussed when the testbed was 
described, so that the intelligence coefficient is a multiple of g. Since the various 
sensors are all complementary, we model them as five distinct intelligence bands. 
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The coordination coefficient for the distributed architectures turns out to be infinite 
(since there is no path between different squadrons), but we substitute the number 15 
for the purpose of statistical analysis. 


Table 4: Eight C4ISR Architectures and Results of FINC Modelling 


coefficient (info) | coefficient (coord) | coefficient (intel) 
Infinity (15) 


Comparing the information flow coefficients in table 4 with the actual time delays 
between intelligence collection and air strike (shown in table 1), we can see that they 
are similar but not precisely identical. This is what we would expect in reality. In 
general, the three coefficients calculated by the FINC methodology (being based on 
estimation process) will be a reflection of reality, but not a perfect one. However, 
although the FINC coefficients are imperfect, regression analysis shows that they 
predict performance extremely well (at least for this “SCUD hunt” scenario). 
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Figure 9: 3-Dimensional Graph of Results of FINC Modelling for Eight C4ISR Architectures 
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Regression analysis produces the following equation of best fit for the number of 
targets destroyed, in terms of the three FINC metrics, and the probability p which 
provides an indication of battlefield tempo: 


0.287 - 8.685 p + 11.992 p? + 0.02566 V/intel -- 0.000003703 intel-coord -- 0.00003692 intel-info-p 


Each parameter here is significant at the P<0.0001 level under two-tailed t-tests, and 
the equation explains 94% of the variance in the experimental data in table 8 (in other 
words, the correlation is 0.97). This is an extremely good result, and is limited only 
by the fact that the equation does not fully capture the complex nonlinearities in the 
data. We provide a more detailed explanation of the equation of best fit below. 


Table 9 in the appendix shows the number of targets destroyed estimated using the 
equation of best fit. It can be seen that the results are not perfect, since the equation 
does not fully capture all the nonlinearities, but for the 30 combinations of p and 4, 
the equation of best fit identifies the best architecture on 12 occasions, the second or 
third best architecture on 14 occasions, and the fourth best architecture on the 
remaining 4 occasions. This provides another indication that the equation of best fit 
is a good one, but the true utility of the equation lies in the principles of C4ISR 
architectures that it embodies, and we address this next, by examining in detail the 
meaning of the different parts of the best-fit equation: 


5.1 Explaining the Equation of Best Fit (a): 0.287 -- 8.685 p + 11.992 p2 


Inspection of the data in table 8 shows that the biggest impact on the number of 
targets destroyed is battlefield tempo, measured by the probability p. The 
relationship between p and the number of targets destroyed is a nonlinear one, and 
so the equation of best fit has a quadratic dependence on p. This explains 61% of the 
variance in the data (a linear dependence on p would explain only 55%). 


Including cubic or higher powers of p does not explain more of the variance, so that 
the remaining 39% of the variance is due to sensor quality and the choice of 
architecture. 


5.2 Explaining the Equation of Best Fit (b): 0.02566 Vintel 


The second largest impact on the number of targets destroyed is the intelligence 
coefficient (which essentially represents an estimate of the total amount of 
information discounted by its age). This explains an additional 23% of the variance 
(for a total of 84%). The relationship between the intelligence coefficient and the 
number of targets destroyed is a nonlinear one, and the square root of the 
intelligence coefficient provides a better indication than the intelligence coefficient 
itself (the intelligence coefficient itself would explain only an additional 20% of the 
variance). 


The significance of this factor indicates the importance of having a high intelligence 
coefficient, or in other words, having information superiority. 
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5.3 Explaining the Equation of Best Fit (c): -0.000003703 intel - coord 


The next factor influencing the number of targets destroyed is the product of the 
intelligence coefficient and the coordination coefficient, which explains an additional 
4% of the variance (for a total of 88%). The coordination coefficient itself provides no 
additional explanatory power. 


The negative coefficient for this factor in the equation indicates the importance of 
balancing a high intelligence coefficient (information superiority) with a low 
coordination coefficient (coordination superiority). The product relationship 
indicates that with low intelligence coefficients (1.6. when sensor quality q is low), the 
need to make the greatest possible use of limited intelligence is paramount (and the 
coordination coefficient is less important). However with higher intelligence 
coefficients (i.e. when sensor quality 4 is moderate to high), the need for coordination 
(i.e. a low coordination coefficient) becomes more important. 


5.4 Explaining the Equation of Best Fit (d): —0.00003692 intel - info - p 


The final factor influencing the number of targets destroyed is the product of the 
intelligence coefficient, the information flow coefficient, and the probability p. This 
explains an additional 6% of the variance (for a grand total of 94%). The information 
flow coefficient itself provides very little additional explanatory power (less than 
1%), and is not included in the equation. 


The negative coefficient for this factor in the equation indicates the importance of 
balancing a high intelligence coefficient (information superiority) with a low 
information flow coefficient (speed, or tempo superiority) when the tempo p is high. 


6. Four Basic Principles of C4ISR Architectures 


Table 5 shows a simplified view of the best-performing architectures in table 3. It 
must be remembered that the transition from distributed architecture being best to 
centralised architecture being best has an intermediate stage where the negotiation 
architecture is best. This table is clearly subdivided into four regions, as shown in 
table 6. 


Table 5: Best-Performing Architectures (Simplified) 


(q=0.1) (q=0.5) (q=0.9) 
Negot. Share 


Fast tempo (p = 0.5) 
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Each of the four performance regions displays a different combination of the factors 
which we identified in the equation of best fit. 


Table 6: Performance Regions 


Fair to Good sensors 
(q=0.1) (q=0.5 / 0.9) 

Slow tempo (p = 0.01) a ae 

Moderate tempo (p = 0.05/0.1) A ς 


Fast tempo (p = 0.5) 


6.1 Region A: Slow to Moderate Tempo and Poor Sensors — 
Intelligence Superiority Critical 


This region is dominated by the need to make the greatest possible use of limited 
intelligence (i.e. to maintain the highest possible intelligence coefficient in the face of 
poor sensor quality), and it is in this region that the distributed sharing architecture 
(the one with the highest intelligence coefficient) performs best. 


6.2 Region B: Slow Tempo and Fair to Good Sensors — Intelligence 
& Coordination Superiority 


This region is dominated by the balance between a reasonably high intelligence 
coefficient and a very low coordination coefficient (i.e. between intelligence 
superiority and coordination superiority), as described in the discussion of the intel - 
coord factor. 


It is in this region that the centralised sharing architecture (the one with the fourth 
highest intelligence coefficient and the lowest coordination coefficient) performs best, 
and this appears to be the region in which the US Air Force operates, with its 
centralised Air Tasking Orders (in this case, tempo is only “slow” in comparison to 
the US Air Force's extremely rapid ability to respond). 


6.3 Region C: Moderate Tempo and Fair to Good Sensors — 
Combined Superiority 


This region is dominated by the balance between a reasonably high intelligence 
coefficient and both low coordination coefficients and low information flow 
coefficients (i.e. a three-way balance between intelligence superiority, coordination 
superiority and tempo superiority), as described in the discussion of the intel - coord 
and intel - info - p factors. At the low-sensor-quality end of this region the intelligence 
coefficient is slightly more important. 


It is in this region that the negotiation architectures performs best (with sharing 
when necessary, and without sharing when sensors are good). The negotiation 
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architecture with sharing balances all three factors with a slight bias towards the 
intelligence coefficient, i.e. information superiority (it has the fourth-lowest 
information flow coefficient, the sixth-lowest coordination coefficient, and the 
second-highest intelligence coefficient). The negotiation architecture without sharing 
balances all three factors with a slight bias towards the information flow coefficient, 
i.e. tempo superiority (it has the second-lowest information flow coefficient, the fifth- 
lowest coordination coefficient and the fifth-highest intelligence coefficient). In other 
words, the negotiation architectures seem to be the most successful at balancing the 
three kinds of superiority, approaching the global optimum produced by the 
centralised architecture while providing a more rapid response. 


6.4 Region D: Fast Tempo — Intelligence & Tempo Superiority 


This region is dominated by the balance between a reasonably high intelligence 
coefficient and a very low information flow coefficient (ie. between intelligence 
superiority and tempo superiority), as described in the discussion of the intel - info -p 
factor. 


It is in this region that the distributed architecture without sharing (the one with the 
third highest intelligence coefficient and the lowest information flow coefficient) 
performs best, and this appears to be the region in which Special Forces operate. 


The existence of this region is consistent with the results of chess-based experiments 
conducted by the Swedish National Defence College [15] which indicate that there 
are environments in which tempo superiority becomes more important than 
information superiority. By our standards, chess is a high-tempo game, since the 
situation can change radically in a single move. 


Table 7 summarises the principles of C4ISR architectures demonstrated in these four 
regions. 


Table 7: Principles of C4ISR Architectures 


Slow tempo 


Fair to Good sensors 


Region B: Balance information superiority and 


Region A: coordination superiority (high intelligence 
Information coefficient and low coordination coefficient) 
Moderate superiority Region C: Balance all three kinds of 
tempo is mostimportant | superiority (high intelligence coefficient, low 
(high intelligence | information flow coefficient, and low 
coefficient) coordination coefficient) 


Region D: Balance information superiority and tempo superiority 
(high intelligence coefficient and low information flow coefficient) 


Fast tempo 
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7. Conclusions 


We have presented a methodology for evaluating and comparing organisational 
structures which we call FINC (Force, Intelligence, Networking and C2), and a very 
simple testbed for evaluating organisational structures. Our experiment has 
validated the FINC methodology, since performance is successfully predicted by the 
three FINC metrics (the information flow coefficient measuring tempo superiority, 
the coordination coefficient measuring coordination superiority, and the intelligence 
coefficient measuring information superiority). 


Analysis of the experimental results identifies four regions (A, B, C, and D) in the 
tempo/sensor quality space in which different kinds of superiority are important. 
This highlights the ways in which different military organisations — air, sea, and 
land — have successfully adapted to suit their intelligence environment and tempo. 
However, as information environments and tempo change, traditional organisational 
structures may no longer be appropriate. 


The first task in designing new C4ISR architectures is therefore to ask: in which of the 
four regions (A, B, C, or D) will the architecture be operating? 


Further work is still required on FINC methodology, specifically on the process for 
the calculating delay factors for headquarters and links, and for assigning quality 
scores to intelligence assets. We also intend to further validate the FINC 
methodology by applying to other simulation experiments and to real-world 
examples. 
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Table 8: Experimental Results for 10,000 Runs 
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Table 9: Estimated Results Produced by Equation of Best Fit 
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